HIGH-VOLUME ON-LINE SPECTROSCOPIC COMPOSITION 
TESTING OF MANUFACTURED PHARMACEUTICAL DOSAGE UNITS 



Cross-Reference to Related Application 

This patent application claims the benefit under 35 U.S.C. § 1 19 (e) of United 
States provisional application No. 60/120,859 filed on February 19, 1999 and of United 
States provisional application No. 60/143,801 filed on July 14, 1999, and the benefit 
under 35 U.S.C. § 120 of application No. 09/507,293 filed on February 18, 2000, now 
United States Patent No. 6,483,1 12 issued on February 10, 2004, which are all herein 
incorporated by reference.. This application also relates to subject matter described in 
copending application serial no. 09/353,325, filed July 14, entitled "High-Throughput 
Infrared Spectrometry," and herein incorporated by reference. 

Field of the Invention 

This invention pertains to quality control systems and methods that detect process 
defects in large-scale manufacturing processes, such as the manufacture of 
pharmaceutical dosage units, using continuous spectral imaging techniques. 

Background of the Invention 

Defects in pharmaceutical products can be highly dangerous, or even fatal. And 
even if such defects are relatively minor, such as non-uniformly sized capsules, they can 
result in a significant loss of goodwill by the manufacturer. It is therefore of the utmost 
importance to avoid such defects. 

Several approaches now exist to screen pharmaceutical agents packaged in 
predetermined dosage units, such as capsules or tablets. These include off-line and on- 
line methods. Off-line methods include the testing of samples of reagents and end- 
products using various analytical methods. On-line methods attempt to monitor the 
process of manufacturing the product to detect defects as they occur. 

A number of on-line screening approaches currently exist. One approach includes 
adding coloring agents to bulk ingredients and optically checking the shape, integrity, and 
color of the final product. Systems employing this approach can take a series of video 
images of dosage units and use image processing methods to assess the shape and color 
of the dosage units. Other systems employ groups of discrete optical detectors to detect 



different colors and infrared detectors to detect the scattering caused by structural defects. 
These systems can be complicated to install and maintain, and cannot guarantee a defect- 
free product. 

Summary of the Invention 

Several aspects of the invention are presented in this application. These relate to 
improvements to process control apparatus and methods, including apparatus and 
methods that detect process defects in large-scale manufacturing processes, such as the 
manufacture of pharmaceutical dosage units, using continuous spectral imaging 
techniques. 

Systems according to the invention are advantageous in that they can 
continuously test the actual composition of each dosage unit within its packaging. Such 
systems can therefore screen for errors in coloring of ingredients, for contamination or 
breakdown that occurs independent of coloring, and for other types of errors that might 
not otherwise be detected. And because systems according to the invention can perform 
their composition measurements through the end-user package walls, they can detect 
contamination or damage that occurs during packaging. 

Performing composition analysis by comparing spectral information with libraries 
of known spectral signatures, allows small concentrations of potentially dangerous 
contaminants, such as potent toxins, to be detected. Without being correlated to a 
specific spectral signature, such small concentrations might have little effect on prior art 
process monitoring methods, and might therefore be dismissed as within an error margin. 

Performing composition analysis by comparing spectral information with libraries 
of known spectral signatures may also allow for the detection of unexpected components. 
Comparing acquired spectral information with libraries of components may uncover 
contaminants not normally associated with the process. This may allow a manufacturer 
to avert hazards that arise out of unforseen circumstances, such as supplier errors or 
deliberate tampering. 

Performing composition analysis by comparing spectral information with libraries 
of known spectral signatures may further allow for the detection of subtle shifts in the 
process. Because relative quantities of ingredients can be directly measured, a change in 
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the ratio of these ingredients can be detected. While such changes may not warrant 
rejection of the products, they may allow the process to be optimized and prevent the 
process from drifting out of its intending operating range. 

Systems according to the invention may also be advantageous in that they can 
allow a process engineer to select optimal process variables to monitor. By mapping 
selected spectral information into an image, which is then processed by an image 
processor, systems according to the invention can apply the image processing resources 
to the spectral data that correlates best to known and predicted failure modes. And 
because the system acquires information about a large number of wavelengths 
simultaneously, a system operator can try a number of different approaches to achieve the 
best results. 

Brief Description of the Drawings 

Fig. 1 is a diagram of an embodiment of a pharmaceutical dosage unit 
manufacturing process control system according to the invention, including a perspective 
portion illustrating the relationship between the image sensor, the spectrally selective 
element, and the process stream; 

Fig. 2 is a plan view diagram of an image sensor for use with the process control 
system of Fig. 1; 

Fig. 3 is a plan view diagram illustrating output of the system of Fig. 1 ; 

Fig. 4 is a flowchart illustrating the operation of the embodiment of Fig. 1; and 

Fig. 5 is a diagram of a second embodiment of a pharmaceutical dosage unit 
manufacturing process control system according to the invention, including a perspective 
portion illustrating the relationship between the image sensor, the spectrally selective 
element, and the process stream. 

In the figures, like reference numbers represent like elements. 

Description of an Illustrative Embodiment 

Referring to Fig. 1 , a pharmaceutical dosage unit manufacturing process control 
system according to the invention features an image sensor 10 and a spectrally selective 
element 12 facing a web 16 that carries a series of parallel rows of pharmaceutical dosage 
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units 18, such as capsules, tablets, pellets, ampoules, or vials, in a process flow direction. 
For example, the web can carry a continuous stream of blister-packaged tablets from the 
output of a packaging machine. The image sensor is a multi-element sensor that includes 
at least a series of adjacent sensing elements located generally along an axis that is 
perpendicular to the flow direction. The spectrally selective element is a wavelength 
separating element, and is preferably a dispersive element, such as a diffraction grating or 
a prism-based monochromator. 

Referring to Figs. 1-2, the image sensor 10 is preferably a two-dimensional array 
sensor that includes a two-dimensional array of detector elements made up of a series of 
lines of elements (Al - An, Bl - Bn, ... Nl -Nn) that are each located generally along an 
axis that is perpendicular to the flow direction. The image sensor can include an array of 
integrated semiconductor elements, such as a Charge-Coupled Device (CCD) array, and 
is preferably sensitive to infrared radiation. Uncooled Idium-Galium-Arsenide (InGaAs) 
arrays, which are sensitive to near infrared wavelengths, are suitable image sensors, 
although sensitivity to longer wavelengths would be desirable. It is contemplated that the 
sensors should preferably have dimensions of at least 64 x 64 or even 256 x 256. Where 
such sensors are not square, they should be oriented with their longer dimension in the 
direction of the process flow, as spectral information appears to be typically more 
important than spatial information given the nature of pharmaceutical mass-production 
equipment. 

The system also includes an image acquisition interface 22 having an input port 
responsive to an output port of the image sensor 10. The image acquisition interface 
receives and/or formats image signals from the image sensor. It can include an off-the 
shelf frame buffer card with a 12-16 bit dynamic range, such as are available from 
Matrox Electronic Systems Ltd. of Montreal, Canada, and Dipix Technologies, of 
Ottawa, Canada. 

A spectral processor 26 has an input responsive to the image acquisition 
interface 22. This spectral processor has a control output provided to a source control 
interface 20, which can power and control an illumination source 14. The illumination 
source for near infrared measurements is preferably a Quartz-Tungsten-Halide lamp. 
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The spectral processor 26 is also operatively connected to a standard input/output 
(10) interface 30 and to a local spectral library 24. The local spectral library includes 
locally-stored spectral signatures for known process components. These components can 
include ingredients, process products, or results of process defects or contamination. The 
10 interface can also operatively connect the spectral processor to a remote spectral 
library 28. 

The spectral processor 26 is operatively connected to an image processor 32 as 
well. The image processor can be an off-the-shelf programmable industrial image 
processor, that includes special-purpose image processing hardware and image evaluation 
routines that are operative to evaluate shapes and colors of manufactured objects in 
industrial environments. Such systems are available from, for example, Cognex, Inc. 

In one embodiment, the system is based on the so-called IBM-PC architecture. 
The image acquisition interface 22, 10 interface 30, and image processor 32 each occupy 
expansion slots on the system bus. The spectral processor is implemented using special- 
purpose spectral processing routines loaded on the host processor, and the local spectral 
library is stored in local mass storage, such as disk storage. Of course, other structures 
can be used to implement systems according to the invention, including various 
combinations of dedicated hardware and special -purpose software running on general- 
purpose hardware. In addition, the various elements and steps described can be 
reorganized, divided, and combined in different ways without departing from the scope 
and spirit of the invention. For example, many of the separate operations described 
above can be performed simultaneously according to well-known pipelining and parallel 
processing principles. 

In operation, referring to Figs. 1-4, the spectrally selective element 12 is sensitive 
to the radiation reflected off of a line across the process web 16, and collimated by a first- 
stage optic, such as a lens (not shown). The spectrally selective element separates the 
spectral components of the reflected radiation along the axis of the process flow. As a 
result, the successive lines Al - An, Bl - Bn, ... Nl - Nn of the image sensor are exposed 
to spectral components of the radiation that are of successively higher or lower 
wavelengths, depending on the relative orientation of the spectrally selective element and 
the image sensor. In one embodiment, a portion of the line image extends beyond the 
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web to overlap with a stationary reference sample 19 located adjacent the web. This 
implementation can allow for the removal of transfer of calibration requirements between 
systems that collect pure component spectra for spectral comparison. 

At a predetermined repetition rate, the image acquisition interface 22 acquires a 
data set representative of the radiation incident on the image sensor (i.e., a spectral line 
image — step 40). This data set includes image values for each of the pixels along the 
imaged line on the process web at a number of different wavelengths. In the case of a 
256 x 256 array, intensity values at 256 different wavelengths will be stored for each of 
256 points on the imaged line. Once it has been acquired, the image acquisition interface 
transfers this data set to the spectral processor 26. 

The spectral processor 26 then evaluates the acquired spectral line image 
(step 42). This evaluation can include a variety of univariate and multivariate spectral 
manipulations. These can include comparing received spectral information with spectral 
signatures stored in the library, comparing received spectral information attributable to 
manufactured dosage units with information attributable to the reference sample, or 
evaluating simplified test functions, such as looking for the absence of a particular 
wavelength or combination of wavelengths. Multivariate spectral manipulations are 
discussed in more detail in "Multivariate Image Analysis," by Paul Geladi and Hans, 
Grahn, available from John Wiley, ISBN No. 0-471-93001-6, which is herein 
incorporated by reference. 

As a result of its evaluation, the spectral processor 26 may detect known 
components (step 44) and/or unknown components (step 46). If an unknown component 
is detected, tjie system records a spectral signature entry for the new component type in 
the local spectral library 24 (step 48). The system can also attempt to identify the newly 
detected component in an extended or remote library 28, such as by accessing it through a 
telephone line or computer network (step 50). The system then flags the detection of the 
new component to the system operator, and reports any retrieved candidate identities 
(step 52). 

Once component identification is complete, the system maps the different 
detected components into a color (such as grayscale) line image (step 54). As the system 
processes further spectral line images, it accumulates a two-dimensional colored image 
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frame. When complete, this image can be transferred to the image processor (step 58), 
which evaluates the shape and color of the dosage units (step 60), issues rejection signals 
for rejected dosage units, and compiles operation logs. 

As shown in Fig. 3, the color image will resemble the process web, although it 
may be stretched or squeezed in the direction of the process flow, depending on the 
acquisition rate. The image can include a color that represents the composition of the 
web 16. It will can also include colors that represent known good components 18A, 
colors that represent known defect components 18B, and colors that represent unknown 
components 1 8C. The mapping can also take the form of a spectral shift, in which some 
or all of the acquired spectral components are shifted in a similar manner, preserving the 
relationship between wavelengths. Note that because the image maps components to 
colors, it provides information about spatial distribution of the pharmaceutical 
composition in addition to identifying its components. 

While the system can operate in real-time to detect defective products, its results 
can also be analyzed further off-line. For example, some or all of the spectral data sets, 
or running averages derived from these data sets can be stored and periodically compared 
with extensive off-line databases of spectral signatures to detect possible new 
contaminants. Relative spectral intensities arising from relative amounts of reagents or 
ingredients can also be computed to determine if the process is optimally adjusted. 

Note that the system presented above is self-scanning. Although it can be 
synchronized with the process by a sensor, such synchronization is not requiredr^The^^ 
system can therefore be easily retrofit to existing installations and does not require any 
moving part?. 

The acquisition method employed by the process control system can also be 
computationally efficient. Since data is acquired and spectrally processed on a line-by- 
line basis, the spectral processor does not have to store large amounts of intermediate 
results. Once a line has been mapped to a colored line image, all of the acquired data and 
intermediate results can be discarded, and a new line processed. This can allow the 
system to operate in real time with relatively simple computer components, keeping the 
overall system cost low. 
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Referring to Fig. 5, a second embodiment of a pharmaceutical dosage unit 
manufacturing process control system according to the invention includes a variable- 
bandpass filter 12a between the two-dimensional array sensor and the process stream. 
This filter has a narrow pass-band with a center wavelength that varies along the process 
direction. The leading edge A of the filter passes shorter wavelengths, and as the 
distance from the leading edge along the process flow direction increases, the filter passes 
successively longer wavelengths. At the trailing edge N of the filter, the filter passes a 
narrow range of the longest wavelengths. The orientation of the filter can also be 
reversed, so that the pass-band center wavelength decreases along the process flow 
direction. Although the filter has been illustrated as a series of strips located 
perpendicular to the process flow direction, it can be manufactured in practice by 
continuously varying the dielectric thickness in an interference filter. Preferably, the 
filter should have a range of pass-bands that matches the range of the camera. Suitable 
filters are available, for example, from Optical Coatings Laboratory, Inc. of Santa Rosa, 
California. 

In operation of this embodiment, acquisition interface 22 acquires data 
representing a series of variably-filtered, two-dimensional images. These two- 
dimensional images each include image values for the pixels in a series of adjacent lines 
perpendicular to the process web. Because of the action of the variable-bandpass filter, 
the detected line images that make up each two-dimensional image will have a spectral 
content that varies along the process direction. 

The variably filtered images are combined as they are acquired in order to obtain 
full-range spectral images. As each imaged line progresses along the web, each 
successive line (Nl ... Al) of elements in the array sensor 10 will sense radiation that has 
been filtered through a corresponding line (N ... A) of the filter. These individual line 
images can be assembled to create a full-spectrum line image. The assembly can take 
place by itself, or in combination with other operations, such as digital filtering 
operations. This embodiment is particularly advantageous because the variable-bandpass 
filter is relatively inexpensive and robust. 

Another approach involves the use of an optical system that simultaneously 
projects a number of spectrally-discrete versions of the same two-dimensional image onto 
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the array sensor 10. Such systems are described in PCT application No. 
PCT/US98/14218 published under No. WO09902950, which are herein incorporated by 
reference. The use of these systems is advantageous in that they allow high data 
throughputs for a given web speed, without adding moving parts. Systems of this type 
are available from Optical Insights, Inc of Tucson, Arizona. 

A further embodiment employs multi-source arrays to provide successive 
illumination at different wavelengths and thereby obtain spectral information from the 
process. Such arrays are described in a copending provisional application entitled 
"Multi-Source Arrays," filed on the same day as this application, and herein incorporated 
by reference. 

The present invention has now been described in connection with a number of 
specific embodiments thereof. However, numerous modifications which are 
contemplated as falling within the scope of the present invention should now be apparent 
to those skilled in the art. For example, aspects of the invention may also be applicable 
to other types of manufacturing processes, such in detecting the presence of undesirable 
by-products in the manufacture of plastic articles. In addition, while a two-dimensional 
image sensor with a dispersive or graded spectrally selective element is at present 
contemplated to be the best approach to acquiring line image data, a one-dimensional 
image sensor coupled with a high-speed filtering system might allow a suitable amount of 
data to be acquired in some circumstances. Therefore, it is intended that the scope of the 
present invention be limited only by the scope of the claims appended hereto. In 
addition, the order of presentation of the claims should not be construed to limit the scope 
of any partipular term in the claims. 

What is claimed is: 
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